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ON  THE  INVERSION  OF  FINITE  AUTOMATA 

[Following  is  the  translation  of  an  article  by 
V.I.  Levenshteyn  in  the  Rueslan-langtiage  perio¬ 
dical  Uoklady  AAadepli  Nauk  3SSR  (Reports  of  the 
Academy  of  scienoee  uSSfe) ,  vol  1 47 ,  No  6,  1962, 
pages  1300-1303.] 


(Iresented  by  Academician  M.V,  Keldysh  4  July  1962) 

Recently,  certain  studies  (ref a  6-8)  have  taken  note 
of  the  common  ground  between  certain  problems  in  ooding  theory 
and  the  theory  of  automata.  Thus,  problems  of  one-to-one  coding 
correspond eiioe  and  the  possibility  of  constructing  a  deeondlng 
device  with  a  finite  memory  have  been  essentially  reduced  to 
the  problems  of  the  mutual  equivalence  of  finite  automata  and 
the  pessihlllty  of  their  inversion.  It  Is  true,  however,  that 
this  has  necessitated  some  extension  of  the  concept  of  the 
automatic  device,  with  the  elimination  of  the  requirement  of 
synchronism,  i»e.,  the  equality  of  the  length  of  the  input 
and  corresponding  output  words.  In  his  study,  Xu.V.  Glsoskly 
(ref  6)  found  an  effective  criterion  for  the  recognition  of 
the  mutual  equivalence  of  a  fully  defined  finite  automato'n 
over  a  flnlte-oountable  set.  The  present  paper  deals  with 
effectively  checkable  necessary  and  sufficient  conditions  for 
the  inversion  of  (asynchronous)  partial  finite  automata,  / 

as  well  as  methods  of  constmotlng  inverse  automata.  In  addi¬ 
tion,  we  construct  recognition  algorithms  for  certain  other 
properties  of  partial  finite  automata, 

1  .  Let^u  a  partial  finite  automaton, 

whereA»l<^./  -jO*  ml  is  the  input  alphabet}  6- —/Wfil®  output 

alphabet; is  the  set  of  states;  Sc,  is  the  initial 

state;  -T  and  are  respectively  the  transition  function  and 
'  output  function  of  the  automaton,  defined. over  a. certain  «uh-^ 
setJl&SXK,  moreover,  If  (sc,cv^)*l^wheres^-  6  S  ,  and 

is  a  certain  (perhaps  empty)  word  in  alphabet  6.  •  The  autp- 
I  maton  ^  is  called  synohroncus,  if  each  word  wv  is  a  latter 
I  Ap  alphabet  B  .  The  automaton  V,  induces  a  function  J 
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STflned  on  oach  vord  of  o^»a- a-  ...  ci.>.  for  vhlchCft,:.-. 

»  ^here  afleuiBlng'^tiho  ^alut^' 

• '^1 '*  addition,  tha  autonaton  XK  induces  a 
a  function  ,  defined  over  each  infinite  eequence 
for  whiola  ^  -^where  there 

aeeumes  the  value  F"(5r)-'^t''A‘  •  .  The  defined  regions  of 
functions  and  ve  shall  denote  hy  and 

spectively.  The  state  into  which  the  autosaton  passes  from 
state  S;  under  the  action  of  the  word  o<.  from  the  alphabet 
will  be  denoted  by  ,  The  two  automata  '54.  and  ^  will 

be  considered  e<iuivalent  If  for  any  word  oC  in  alphabet  A 
we  have  [see  note]  as  we  are  oonoerned 

with  automata  with  an  aocuraoy  up  to  the  limit  of  equivalenoe , 
we  can  assert  without  any  loss  of  generality  that  all  states  of 
the  automaton  %  are  distinguishable  and  for  any  state  (,S 

,th.r«.  exUM  »,.!toW  4 

Eere,  as  usual, Fj.(oO=  %(«<)  means  that  either  both  functions 
are  undefined  for  the  wurdf  or  are  defined  for  this  word 
and  take  on  the  smae  values)* 

_  The  automatcn  %  will  be  called  amtuallv-s Inal# ^valued 


.OSS  reee  note 
iuob  that 


If  for  anay  distiac  o  words  o<,  end  o(  from  we 

The  automaton  2^  will  be  called  mutually-alnala -valued  in  the 
miLgaflgg  or  an  automaton  ]a^]aa.t.,;tfgn?frU9B  ]-ggI.  I***  notlp 
If  for  any  distinct  words  (x^and  p(^rroiB  x.v^  ,  euoh  that 

the  states  FO*:.  and  fC*;,  ,cii.3,^are  distinct*  The 
automaton  will  be  called  autually-iicgle«valued  over  infinity 
if  for  a^  dietinot  sequences  '^,and  olv  from  we  have 

(fNotej]  The  latter  neme  wae  euggeated  by  Huffman 
(ref  3)  who  studied  such  automata  in  detail  for  the  eynohronous 
case*  This  name  reflects  the  feot  that  a  fully-defined  auto¬ 
maton  is  mutually-eingle-valued  in  tha  weak  sense  if  and  only 
if  there  ezlste  an  experiment  (ref  2)  of  finite  length  with 
automaton  %  processing  a  random  word  ov  (unknoini  to  the  ex¬ 
perimenter)  which  mekee  possible  the  determination  of  tha  word 
o<,  from  the  output  p^(,g()and  the  resulte  of  the  experiment)* 

To  simplify  further  formulations,  let  us  Impose  the 
following  limitation  on  the  region  of  definition  for  automaton 
:  each  word  from  Lv^  is  the  start  of  at  least  two  dietinot 
I  sequences  from  •  With  this  limitation,  the  following  , 
Llemma  will  hold* ^ 
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,  Leaaa  1  «  If  the  automaton  x  is  mu tually-s Ingle-  ^ 

Valued  over  infinity,  It  is  mutually-elngle-valued  In  the 
weak  aense. 

It  is  obvious  that  a  mutualiy-slngle-valued  automaton 
is  mutually-slngle-valued  in  the  weak  sense.  Figure  1  shows 
a  diagram  of  an  automaton  mutually-s ingle -valued  in  the  weak 
sense  which  is  neither  mutually-s ingle -valued  not  mutually- 
single-valued  over  infinity. 


Figure  1 

If  for  the  automaton  ^  there  exists  an  automaton 
such  that  automaton  will  be  called  Inver  - 

^  ^  A' 

and  automaton  ^  will  he  called  the  inverse  of  "IS* 

It  is  easy  to  see  that  for  a  synchronous  automaton 
there  exists  a  synchronous  automaton  inverse  to  Hi  If  and  only  if 
automaton  !V>  is  mutually-single-valued  (refs  3,  ^).  The  diagram 
cf  the  inverse  automaton  is  obtained  form  the  diagram  of  automaton 
through  the  Juxtaposition  of  the  Input  and  output  letters 
assigned  to  the  connective  ribs.  Let  us  note  that  the  mutual 
8 ingle -valuedness  of  the  automaton  Is  not  necessary  even  for  the 
inversion  of  a  syTichronoua  automaton  (Pigs  2  and  3). 

The  difficulties  arising  in  the  general  case  are  due  mostly 
to  the  following  factors  ;  1  )  the  class  of  functions  Induced 

by  the  automata  is  considerably  wider  than  xhe  class  of  functions 

induced  by  the  synchronous  automata}  2)  for  any  automaton 
there  exists  a  countable  number  of  paired  nonequlvalent  auto¬ 
mata  Inducing  (as  distinct  from  the  unitary  automaton  with 
an  accuracy  up  to  the  equivalence  of  the  automaton  in  the  synchron¬ 
ous  case). 

2,  To  construct  effective  criteria  permitting  us  to 
recognize  the  indicated  properties  of  automaton  %  ,  1st  us  I 


jlntroduce  the 
and  Patterson 


sets  Cn- (,i,  .) analogous  to  the 

classes  (ref  1),  The  sets  R^C%)are 


Sardlnas  ~~j 
determined 


by  indue  their  elements  are  ordered  triplets  of  the 

form  ({i,  ,  where  ^  is  the  ending  of  some  word  ,  and 

C  and  H  are  state  numbers.  The  set  is  defined  as  the 

combination  of  all  elements  for  which  there  exist 

(f- ^  S;'' -  P(s,-^4^and 

(gj3'-.-V'  or  s,.  ^  rCt::  i^p>^,-\and  P>  f>'  . 

*  lemma  2.  The  element  (f/v »  belongs  to  and  only 

If  there  exist  numbers  ^  t>  I ,  k+t  -  ~ 

)'.•  h, ,  h,d,;  -v'*C 

^\r:'  1^) 

41  "'ll.  j  ^  • 


{ 


41  '  il.  J  K  CT*. 

the  word  fi  la  the  ending  of  word 


where  I .  ~  I' t  ;  >  1  ^  ,  and 


V  H 
At 


Let  us  establish  the  following  notation:  an  empty  word 
Is  A  I  the  length  of  word  A  In  alphabet  g>  is  A(b)  »  and  the* 
maximum  length  of  words  v‘  '  Is  A.  f'fom  lemma  2  It  follows 

that  there  exist  not  more  than  f^^(iivA,na<A*'i)  ®l®m»at8  which  can 

make  up  the  sets  .  Consequently,  tnese  sets  begin  to 

recur  periodically  at' some  point. 

Theorem  1  .  Automaton  %  will  be  mutually-alngle-valued 
If  and  only  if  all  words  vj  are  nonempty  and  no  set  con¬ 
tains  words  of  the  formC«\yC,Vv)  for  n4N»v>  -  0  vNCN-^^*A, 

Theorem  2.  In  order  for  the  automaton  ^  to  be  mutually- 
single-valuei  in  the  weak  sense,  It  is  necssaary  and  suffiolsnt 
that  no  set  Rn(M)  contain  elements  of  the  fnrm^  i  ;)for  4, 

•<  N’nh  V  k  N  :•»  dU  » 

Theorem  3.  In  order  for  the  automaton  Ti  to  he  autually- 
B Ingle -valued  over  infinity,  It  Is  necessary  and  sufflcisat  that  • 

all  sets  RflO^be  empty  starting  with  acme  r\  A 


Theorems  1  -3  lead  to  algorithms  for  the  determination  of  ^ 
the  the  investigated  properties  of  automaton  ik  consisting  in 
the  ordered  construction  and  study  of  a  finite  number  of  sets 

These  algorithms  are  generalisations  of  the  corresponding 
algorithms  In  refs  1  and  5*  .. 

Theorem  4.  Automaton  will  he  Invertible  If  and  only  if 
It  Is  mutually-single-valued  over  infinity. 

The  necessity  of  the  above  condition  Is  evident.  Kow 
t  automaton  be  mutually-single-valued  over  infinity,  _J 


L 
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[Then,  by  Theorem  3  there  exists  a  minimum  numher  such"**! 
that  ail  sets  are  empty  forfu^rtCH)  •  V®  proceed  * 

to  describe  methods  of  eenetructing  automata  and  Inreree 
to 


aad  th«  dtiBiers  C  ,  Buoh  that  S;  . 

J’-'i.,  The  combination  of  numbers  will  be  called 

the  C-decoding  of  the  word  g  .  Let a  -  .  , 

Vi  .(U,  j'vCt)  .  ■•  / i  ^ 

oe  all  (^-decodings  of  the  word  fi  and  h'(js/t^the  greatest 
number  such  that  kCO^K' ^  ^  a)  =  ^  .)  r  r‘-”  A'* 

3y  Theorem  3  and  Lomias  2  there  exists  a  minimum  number  T«.Ch('HV«2.1) 
(the  sajr.e  for  all  pairs  .r;)eU' )  such  that  if  for  some 

we  Imje  kCt)5>  i  and  .\(V; ;  (*t\  .  then  k(t)^  i  for 

each  frCt  .->1^ .. .  H_>  and  uhe  cumber  >o  ,  For  the  pairs 

let  us  define  the  following  functions  :  ■\i/,  (jS^  C>  l^.'vi  ^  (ji,L  )  ^ 

*  •••■”  -  particular,  if  k.^  O  / 

then  *  A.  •  denote  by  the  set 

of  words  ^  such  that  and  sC^.O-.A-*  As  the  states  of 

the  auioaaton  we  take  the  symbolH  0,4  ^  ^ 

including  the  symbol  (even  if  fi  which  we  shall 

consider  the  initial  state.  It  is  obvious  that  the  number  of 

states  does  not  exceed  ^1*  functions  f  '  and  \P^ 

'T  ~  i'  ■  ' 

of  the  transitions  and  outputs  of  automaton  ^  will  be  defined 

on  the  pairs  »  for  which  (p,h ^  T('  ,  in  the  follow- 

ing  «.y:  f'Co^/.bp  = 

The  construction  ends  with  the  unification  of  the  undistlngulsh- 
able  states  of  the  autoicaton  and  the  rejection  of  those  states 
which  cannot  be  reached  from  the  initial  state  o>2  ,  ([Kotet] 

From  Lemma  t  and  the  fact  that  an  automaton  mutJally-slngle- 
valued  in  the  weak  sense  cannot  produce  moi'e  than  N-1  empty  words 
, in  aequenee,  It  follows  that  the  number  of  t  *  decondlngs  of 
{ the  word  ^  is  finite).  I 
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F*  . i,S.e.S,.Jl£,^^tn 

fe.is  metnud  differs  from  the  one  preceldlng  merely  In  a  ' 
different  definition  of  the  functions  and  : 

if  k'*0  or  and  V,(^0*S 


Mi A', if  H/  ^  \ 


and  X(v/,;i ----v^^T^^rD-T,  then 


V  •'> 


is  the  greatest  number  such  that 


t  ^iK-tu'ancI  7v(V^""*‘  ■-■V-'‘V*''‘Y 


« 


Figure  2.  Automaton  5H  Figure  3.  Automatons  inverse  to 

automate^  (Fig  2),  a  —  auto¬ 
maton  iM  ;  b  —  automaton  • 

The  selection  of  automata  M  '  and  ^  "  from  the  countable 
aet  of  other  automate  inverse  to  5i>*»  is  explained  by  their  spe¬ 
cial  significance  in  coding  theory.  If  we  assume  that  automaton 
){^  ie  used  for  aiaseage  encoding,  automata  and 
oonsldered  as  decondlng  automata,  the  first  of  which  deaodes 
each  mesaage  with  a  minimal  lag  not  greater  than  “T  ,  while  the 
second  (in  the  case  of  non-empty  words  )  decodes  each  message 
with  a  minimal  constant  lag  "T  .  The  automaton  ,  as  well  as 
automaton  /l^*'  in  the  cited  Instance  are  determined  by  these  con¬ 
ditions  unemblguously  with  an  accuracy  up  to  the  limit  of  equiva¬ 
lence. 

note  1 ,  There  exlet  invertible  partial  automata  (see 
Pig  3,  for  example)  for  which  any  automata  obtained  by  their 
fiirther  definition  without  an  expansion  of  the  output  alphabet, 
are  invertible. 

Kote  2.  Prom  Theorem  4  it  folloxe  that  if  5^  is  a  finite 
automaton  and  the  functlon(^p;|f)“^  Is  induced  by  the  automaton 
Iheving  an  infinite  aet  of  st^ee,  It  is  induced  by  some  finite 
lautomaton  _J 
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SYKTHSSI3  OP  A  CLASS  OP  OOMPUTSRS 

[Following  is  the  traaislatlon  of  an  article  by 
M.V.  Rybashov  In  the  Russian-language  periodical 

If  nkT- 

pages  1304-1305.] 


(Presented  by  Academlolan  V.A.  Trapeznlkov  4  June 

1962) 

In  automatic  control  systems  there  often  arises  the 
need  for  devices  to  carry  on  automatic  tracking  of  one  of  the 
*•00 ts  x*(t;  =  of  a  system  of  finite  equations 


fj_(x^  My  ,...»Uy)  =  0 


(I  s  1 


with  time -variable  parameters 

In  moat  oases  the  variables  are  not  ezpreased 

analytically  In  terms  of  Indlependent  variables,  so  that  the 
problem  is  usually  handled  by  analog  oomputer  methods  (ref  i ) 

Which  make  possible  functional  transformations  with  functions 
Xi  ss  x^(u^  , . , .  ,Up)  given  Implicitly  by  system  (1  ). 

Usually  (ref  1  )  a  oomputer  for  the  construction  of  im¬ 
plicit  functions  Is  designed  according  to  the  prinolpls  of  con¬ 
tinuous  formation  of  the  shifts  ^  ^  =  f^  In  the  course  of  changes 

In  variables  u^  Root  tracking  with  the  aid  of*suoh  a  device 

is  unavoidably  accompanied  by  an  error  In  the  established  regime. 
]flth  considerable  speeds  of  variation  of  variables  u^  ,...,u^  the 

error  may  turn  out  to  be  considerable,  which  under  certain  con¬ 
ditions  leads  to  root  bifurcation. 

In  the  present  article  we  describe  a  method  of  synthe¬ 
sising  systems  for  tracking  roots  In  the  stable  regime  with  an 
error  equal  to  zero, 

I  1 " ,  Let  us  suppose  that  the  functions  f ^  srs  continuously 
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Idlfferentiable  with  respect  to  all  their  arguments  in, 

‘region.  1)  oovereti  in  the  t?olution  of  sjrstes  v1),  and  the 
functions  «}j(t)  sre  finite  and  dlfferentiahle  with  respect 

to  t.  In  addition,  the  system  of  functions  fj^(i  =  1  ,..•»») 

has  a  non -degenerate  Jacohlan  i  -  ^ S  Xj^}  everywhere  in  C. 

Let  us  consider  the  systciE  of  equetions 

d  f  dt—  $4^fj!(»«»*f^)f  I  —  1,««»,n,  (2) 

where  the  functions  as  functions  of  the  argruaents 

everywhsre  satisfy  the  Lipsohita  conditions  and  are  chosen  such 
that  system  (.S)  ha?,  a  slRfsrular  acyaptotically  stable  rest  point 
f  ss  0  (f^  =  f^  fjj,  "  in  the  phase  space  P  with  coordin¬ 
ate  axes  As  such  a  system  we  can  have,  for  example, 

the  following!  * 

dfj^/dt  ~  -  A  >  0,  1  s  1  , .,a.  (3) 

System  (2)  iapllcitlY  gives  the  system  of  equations  '* 

with  respect  to  variahlee  y^ 

dy/dt  .-=  -  Bdu/dt)‘  (4) 

where  dy/dt,  du/dt,  4?  coluran  matrices  of  the  derivatives 
and  functions  respectively;  IV  Is  the  Inverse  of  the  Jacohiani 

B  ia  the  matrix  (n  X  r)  of  derivatives  System  (2)  has 

the  following  properties.  Any  solution  {where  k  Is  the 

number  of  the  solution)  of  system  (1  )  is  a  special  solution  of 

system  (4)  because  the  point  f  s?  0  is  the  rest  point  of  system 
(2).  >rith  initial  conditions  jit^)  s  satisfying  equations 

(1),  the  solution  y(t,y(t^))  of  the  system  of  equations  (4)  for 

all  t  >  t^  will  satisfy  the  system  (1),  since  for  t  >  t^  as  a  * 

result  of  (2)  we  have 

i'i(y(t,y{t^) ),  u(t))  so,  1  =  i,..»,n. 

If  for  t  IS  0  not  all 


L. 
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because  of  the  asjnptetlc  etablllty,  at  t  t^,  all  theTj 
^  ^  will  tend  to  *ero,  and  as  a  result  of  the  differentiability 
of  the  functions  fj^  and  the  flniteneas  of  the  function  Uj(t), 
the  following  evaluation  will  hold: 


®max^  ^fi****  6^1  t 

'l:s1 


c  s  const* 

Proffl  the  evaluation  it  follows  that  the  phase  trajeotorisi 
y(t)  =  (where  k  is  the  number  of  the  root  of  systsn  (1)) 

are  asyaptotlcally  stable. 

The  djmaEic  error  will  fall  off  with  time.  In  praotios 
this  means  that  upon  the  completion  of  the  transient  proosss  the 
error  of  the  stable  regime  will  be  zero*  At  the  same  time,  there 
is  a  fixation  of  the  root. 

Equation  (4)  is  realized  by  means  of  analog  techniques 
such  as  computing  el'ements  In  slsctronic  modsls. 

ifith  the  aid  of  syatem  (4)  it  is  likeirise  poeslbls  to 
find  the  roots  of  finite  equations  (ref  2),  In  this  cast  u* 
s  const,  u,  so,  ,1  =  1,.,.,n.  The  rest  points  of  the  equations 

V 

dy/dt  =  a’$  ,  dy/dt  =  (det  A)^0^  , 

where  C  is  a  matrix  Adjoint  to  matrix  A,  are  asymptotloally 
stable  and  oolneide  with  the  roots  of  system  (1)*  With  the 
specification  of  initial  conditions  in  the  region  of  attraction 
of  a  given  root,  the  representing  point  will  henceforth  tend 
toward  that  root, 

2**  *  Let  us  consider  the  matrix  equation: 


df/dt  =  0. 

The  rest  point  f  s  0  in  this  equation  is  Lyapunov-stable, 
as  ere  the  trajectories  y(t)  S  equation 

dy/dt  a  -l’B{du/dt).  (5) 


The  computer  with  equation  of  motion  (5)  mahte  it  pos¬ 
sible  to  perform  tracking  of  the  root  with  an  error  not  sxoesding 
£  .  Indeed,  with  the  trajectory  IqrapunoT-e table  for  a  glTen£>0, 
there  exists  a  o  ( £  )>  0  suoh  that  if  the  error  in  the  initial 
jeonditione  .  ^ 
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i  ==  (J,  (xj(t^)  -  -not  «2:oeed  S  , 

w^lth  t  ^  t.  fbe  error  -will  not  exc^^'i  specified  figure  €L  • 
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